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* * * 

Field of the invention 

The present invention relates to texture 
compression techniques , 

Compression and decompression intended to minimize 
the memory size needed to store 2D textures is a 
promising field of application for these techniques in 
the 3D graphic domain. This possible field of use is 
becoming more and more significant as the dimensions 
and number of these textures tend to increase in real 
applications. The level of detail tends to increase as 
required by some applications, such as 3D games, and, 
without the help of such techniques, memory size and 
bandwidth for access would tend to require increasing 
performance levels hardly sustainable in mobile, ultra 
low power, handheld systems. More to the point, these 
techniques are becoming increasingly important in 
wireless phone architectures with 3D games processing 
capabilities. 

For example, assuming a texture dimension of 512 x 
512 pixels 16 bit/color each and a depth of 3, the 
amount of memory needed is 1.5 M bytes. Assuming 20-30 
frames per second, the memory bandwidth is 30 to 45 
Mbytes/s. 

Additional background information on this topic 
can be gathered from "Real-Time Rendering" by Tomas 
Akenine-Moller and Eric Haines, A.K. Peters Ltd, 2 nd 
edition, ISBN 1568811829. 

Description of the related art 

A well-known solution in this scenario was 
developed by the company S3; the related algorithm is 
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designated S3TC (where TC stands for Texture 
Compression) . 

This has become a widely used de-facto standard 
and is included in the Microsoft DirectX libraries with 
5 adhoc API support . 

Compression is performed off-line at system 
initialization and next the textures are stored in the 
main memory. Decompression processes act to decompress 
textures accessing the memory run-time when needed by 
10 the graphic engine. This means that only decompression 
is implemented in hardware form while compression is 
not . 

Important parameters for the decompression engine 
are: steps needed to decompress textures and possible 
15 parallel operation; low latency between data-access- 
from-memory and data-out-f rom the decompression engine. 

In order to better understand operation of the 
S3TC algorithm one may refer to an image in RGB format 
where each color component R (Red) or G (Green) or B 
20 (Blue) is a sub-image composed by N pixels in the 
horizontal dimension and M pixels in vertical 
dimension, if each color component is coded with P 
bits, the number of bits per image is N*M*3*P. 

For example, assuming N=M=2 56 and P=8, then the 
resulting size is 1,572,864 bits. If each sub-image R 
or G or B is decomposed in non-overlapping blocks of Q 
pixels in the horizontal dimension and S pixel in the 
vertical dimension, the number of blocks per sub-image 
18 < N * M >/<Q*S) while per image is [3 (NM/ (Q*S) ] and the 
30 number of bits per block is [3*(Q*S)]*P if for 
example Q=S=4 and P=8, then the resulting size of each 
block is 384 bits. If the number of bits per channel is 
R=5, G=6, B=5 then the resulting size of each block per 
image is (4*4) * (5 + 6 + 5) =256 bits. The S3TC algorithm is 
able to compress such an amount of data by 6 times when 
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R=8, G=8„ B=8 and 4 times when R=5, G=6, B=5.. 64 bits 
compose' the resulting compressed block always sent to 
decompression stage. This number is the results of the 
coding steps described below assuming Q=S=4 . 

To sum up, operation of the S3TC algorithm may be 
regarded as comprised of the following steps: 

i) Decompose the RGB image in non- overlapped 
(Q=4)*(S=4) blocks of R G B colors 

ii) Consider the following block composed by 16 
pixels each one composed by R, G and B color 
components : 

Pij = Rij U Gij U Bij (this denotes the pixel at the 
ij position the RGB image, and U is the union 
operator) 

(Rll Gil Bllj (R12 G12 B12) (R13 G13 B13) (R14 G14 B14) 
(R21 G21 B21) (R22 G22 B22) (R23 G23 B23) (R24 G24 B24) 
(R31 G31 B31) (R32 G32 B32) (R33 G33 B33) (R34.G34 B34) 
(R41 G41 B41) (R42 G42 B42) (R43 G43 B43) (R44 G44 B44) 



iii) Decompose the block above in three sub-blocks 
called sub-block R, sub-block G and sub-block B as 
25 shown herein below, each block including only one color 
component : 

Rll R12 R13 R14 sub-block R 
R21 R22 R23 R24 
R31 R32 R33 R34 
30 R41 R42 R43 R44 

Gil G12 G13 G14 sub-block G 

G21 G22 G23 G24 

G31 G32 G33 G34 

35 G41 G42 G43 G44 



Bll B12 B13 B14 sub-block B 
B21 B22 B23 B24 
B31 B32 B33 B34 
B41 B42 B43 B44 



as shown in figure 1. 

Specifically, figure 1 shows RGB blocks ordered in 
different planes, with a RGB block shown on the left 
and a corresponding de- compos it ion shown on the right. 

iv) Sort in ascending order each sub-block color 

v) Detect the black color, which is a pixel made 
of R=o and G=0 and B=0 

vi) If the black color is not detected, then set a 
color palette made by 

a. 1st color is the minimum value of sub- 
block R (min_R), minimum value of sub-block G 
(min_G) , minimum value of sub-block B (min_B) . 

b. 2nd color is the maximum value of sub- 
block R (max_R), maximum value of sub-block G 
(max_G) , maximum value of sub -block B (max_B) 

c. 3 rd (intl) is composed by (2*min R +ma x 
R)/3 (IntlR), (2*min G + max G)/3 (IntlG) , ( 2 *min 
B+max B)/3 (IntlB) 

d. 4 th (Int2) is composed by (min R+2*max 
R)/3 (Int2R), (min G + 2*max G) /3 (Int2G) , ( min 
B+2*max B)/3 (Int2B) 



vii) Otherwise, if black color is detected then 
set a color palette made by 



a. I s color is minimum value of sub-block R 
(min_R) , sub-block G (min_G) , sub-block B (min_B) 
where each of them must not be equal to zero (the 
black color component) at the same time 

b. 2 nd color is maximum value of sub-block R 
(max_R) , sub-block G (maxj3) , sub-block B (max_B) 

c. 3 rd (Intl) is composed by (min R+max R) /2 
(IntlR), (min G+max G) /2 (IntlG) , (min B+max B) /2 
(IntlB) 

d. 4 th is the black color that has R,G,B 
components equal to zero 

viii) if black color is not detected define the 
look-up color palette as 

Look-up table = [ Min_R, IntlR, Int2R, Max_R] 

[ Min_G, IntlG, Int2G, Max_G] 
[ Min_B, IntlB, Int2B, Max_B] 

If black color is detected define the color 
palette as 



Look-up table = 



[ MinR, IntlR, MaxR 0] 
t MinG, IntlG, MaxG 0] 
[ MinB, IntlB, MaxB 0] 
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ix) Associate the following 2 bits code 
boldface, under the palette) to each column of the 
above palette 

Look-up table = [ M inR, mtlR, mt2R, MaxR] 

[ MinG, IntlG, Int2G, MaxGJ 

E MinB, IntlB, Int2B, MaxB] 

00 01 10 ii 

Look-up table = [ M inR, IntlR/ MaxR Q] 

[ MinG, IntlG, MaxG 0] 
[ MinB, IntlB, MaxB 0] 
00 01 10 11 

15 x) For each Pij = Ri . „ Gij y B±j (where . ^ 

from 1 to Q=4 and j ranges from 1 to S=4) compute the 
Euclidean distance Dist between it and each look-up 
color as defined above in vi.a,b,c,d or vii. a ,b,c,d 
depending if black color has been detected or not 
Essentially this is the Euclidean distance between two 
poxnts in a three-dimensional coordinate space. Also 
the difference is within a homologous color component 
(between R or G or B) . 

25 Distl = VdR^-MinRl^lGii-MinGl^lB^-MinBl 2 ) 

Dist2 = VdRij-mtlRl^lG^-IntlGl^lBij-IntlBl 2 ) 
Dist3 = V(|R ij -Int2R| 2 + | Gij -Int2G| 2 + |B ij -Int2B| 2 ) 
Dist4 = VdR^-MaxRlVlG^-MaxGp+lBij-MaxBl 2 ) 

30 xi) For each Pij = Rij y 0±j „ ^ f±nd ^ min±mim 

distance among Distl, Dist2, Dist 3 and Dist4 . For 
example let it be Distl. 
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xii) Send to a decoder process the code associated 
to the color enclosed in the look-up table that has the 
minimum distance. If it is Distl then the code is 00. 



xiii) The decoder receives for each Q*S block as 
shown in figure 2 

a. a two-bit code for each Pij that are 
addresses to the look-up table 

b. MinR MinG MinB 



c. MaxR MaxG MaxB 

xiv) If Min is received before Max by the decoder 
then black has been detected by the encoder otherwise 
not 

xv) As shown in figure 2, the decoder operates as 
described in steps vi or vii depending on black color 
detection, computing 

a. IntlR IntlG IntlBand Int2R Int2G Int2B if 
black color is not detected by encoder 

otherwise 

b. IntlR IntlG IntlB if black color is 
detected by encoder 

* 

xvi) As shown in figure 2, the decoder addresses a 
look-up table with 2 bits code associated to each Pij 
and replaces it with the color stored in the look-up 
table color palette. Specifically ST, LUT, and CT 
indicate the source text, the look-up table, and the 
compressed text, respectively. 
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Figure 3 shows how the data sent to the decoder 
are arranged in a bitstream and if the black color is 
not detected, while figure 4 shows the opposite case. 

As stated before, the compression ratio is 6:1 or 
4:1. This is because if colors are in R=8 G=8 B=8 
format then 3 84 bits are coded with 64 (3 84/64=6) and 
if colors are in R=5 G=6 B=5 format then 256 bits are 
coded with 64 (256/64=4) . 

As shown in figure 3 and 4, the sum of all the 
bits amounts to 64 . 

Object and su mmary of the invention 

However satisfactory the prior art solution 
considered in the foregoing may be, the need is felt 
15 for alternative texture compression/decompression 
techniques of improved quality. 

The aim of the present invention is thus to 
provide such an alternative, improved technique, 
leading to better performance in terms of quality 
achieved and complexity needed for its implementation. 

According to the present invention, such an object 
is achieved by means of a method having the features 
set forth in the claims that follow. The invention also 
encompasses the decoding process as well as 
25 corresponding apparatus in the form of either a 
dedicated processor or a suitably programmed general - 
purpose computer (such as a DSP) . m that respect the 
invention also relates to a computer program product 
directly loadable into the memory of a digital computer 
30 such as a processor and including software code 
portions performing the method of the invention when 
the product is run on a computer. 

Essentially, the' preferred embodiment of the 
invention provides a significant improvement over prior 
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art solutions such as S3TC from different viewpoints, 
since it uses the following compression tools: 

color prediction, 

color-de -correlation, 

- sorting of the prediction errors, 

- generation of the look-up table, 

- bitstream packing, and 
decoding process. 

These tools are different from those used in S3TC or 
not even provided in S3TC, 

Brief descriptions of the drawings 

The invention will now be described, by way of 
example only, with reference to the annexed figures of 
drawing, wherein: 

- figures 1 to 4, pertaining to the prior art, 
have already been described in the foregoing, 

- figure 5 shows a R or G or B sub-block sorted 
from left to right in ascending order in a possible 
embodiment of the invention, 

- figure 6 is a block diagram of a pipeline 
arrangement to evaluate the performance ' of the 
compression and decompression techniques described 
herein, 

- figures 7a to 7h are diagrams showing the 
directions used to scan and predict pixels in the 
arrangement shown herein, and 

- figures 8 and 9 show additional details of 
possible embodiments of the arrangement described 
herein. 

Detailed description of preferred embodiments of 
the invention 

A first embodiment of the invention will now be 
described by using the same approach previously adopted 
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for describing:, in the case of Q=s=4, the S3TC 
arrangement . 

This method will first be described by referring 
to an exemplary embodiment where Q=S=3 . 

i) Decompose the RGB image in non-overlapped QxS 
blocks of RGB colors 

ii) Consider the following 3x3 block composed by 
nine pixels each one composed by R , G and B components: 

Pij = Rij U G i: j U B i;j (where Pij again denotes the 
pixel placed in the ij position in the R G B image, and 
U is the union operator) 

(Rll Gil Bll) (R12 G12 B12) (R13 G13 B13) 
(R21 G21 B21) (R22 G22 B22) (R23 G23 B23) 
(R31 G31 B31) (R32 G32 B32) (R33 G33 B33) 

iii) Decompose the above block in three sub-blocks 
called sub-block R, sub-block g and sub-block b 
respectively, as shown below, wherein each block 
includes only a color component: 

Rll R12 R13 sub-block R 
R21 R22 R23 
R31 R32 R33 



Gil G12 G13 sub-block G 
G21 G22 G2 3 
G31 G32 G33 

Bll B12 B13 sub-block B 
B21 B22 B23 
B31 B32 B33 
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iv) Define a 1st predictor for each sub-block 

a. R22 as prediction for all colors in the 
same sub-block R excluding R22 

b. G22 as prediction for all colors in the 
same sub-block G excluding G22 

c. B22 as prediction for all colors in the 
same sub-block B excluding B22 

v) Compute for each sub-block, the following 
prediction differences: 

a. Sub-block R 

i. (R22-R11) , (R22-R12) , (R22-R13) , (R22- 
R21) , (R22-R23) , (R22-R31) , (R22-R32) , (R22-R33) 

b. Sub-block G 

i. (G22-G11) , (G22-G12) , (G22-G13) , (G22- 
G21) , (G22-G23) , (G22-G31) , (G22-G32) , (G22-G33) 

c. Sub-block B 

i. (B22-B11) , (B22-B12) , (B22-B13) , (B22- 
B21) , (B22-B23) , (B22-B31) , (B22-B32) , (B22-B33) 

vi) Sort in ascending order the prediction 
differences in each sub-block as shown in figure 5: 
specifically, the figure shows R or G or B sub-block 
prediction differences sorted from left to right in 
ascending order; each number is the position in 
ascending order that addresses each prediction 
difference . 

vii) Set up a look-up prediction difference 
palette wherein 
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a- 1 value is the minimum for the 
prediction differences in sub-block R. The same 
applies for the prediction differences in sub- 
blocks G and B, thus yielding min_errorR, 
min_errorG, min_errorB ; 

b- 2 nd value is the maximum for the 
prediction differences in sub-block R. The same 
applies for the prediction differences in sub- 
blocks G and B thus yielding max_errorR, 
max_errorG, max_errorB. 

c. 3 rd is Intl composed by 

i . IntlR= (2*min_errorR+max_errorR) /3 , 
IntlG= (2*min_errorG+max__errorG) /3 , 
IntlB= (2*min__errorB+max_errorB) /3 

d. 4 th is Int2 composed by 

i . Int2R= (min_errorR+2*max_errorR) /3 
Int2G= (min_errorG+2 *max_errorG) /3 , 
Int2B= (min_errorB+2*max_errorB) /3 

(In fact the relationships reported in the 
foregoing correspond to the presently preferred choice 
within the general relationships: 

Intl (R, G, B) 

= (a*min_errorR+b*max_errorR) / (a+b) , 
(c*min_errorG+d*max_errorG) / (c+d) 
(e*min_errorB+f *max_errorB) / (e+f ) , 

Int2 (R, G, B) 

= g*min - errorR+h*max__errorR) / (g+h) , 
(i*min_errorG+l*max_errorG) / (i+1) , 
(m*min_errorB+n*max_errorB) / (m+n) 



where a, b, c, d, e, f, g, h, i, 1, m, 
and n are weighing factors) . 
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viii) Define a look-up prediction error palette 
as 

Look-up table= 

[Min_errorR, IntlR, Int2R, „ Max_errorR] 
[Min_errorG, IntlG, Int2G, Max_errorG] 
[Min_errorB , Int IB , Int2B , Max_errorB] 

ix) Associate the following 2 bit code with each 
column of the above palette 

Look-up table = 

[Min_errorR, IntlR, Int2R / Max_errorR] 

[Min_errorG, IntlG, Int2G, Max^errorG] 

[Min^errorB, Int IB, Int2B, Max_errorB] 

2 BIT CODE = 00 01 10 11 

x) For each Pij = R ±j u Gij U Bij (where i ranges 
from 1 to Q=3 and j ranges from 1 to S=3) compute the 
prediction error using P22 as predictor. 

a. The prediction error is defined as Eij = 
E Rij U E Gij U E Bij = (R 2 2-Rij) U (G 22 -G ± j) U (B^-Bij) 

xi) For each E ± j compute the Euclidean distance 
between it and each look-up color as defined above in 
step ix. This- i& again the Euclidean distance between 
two points, in a three-dimensional coordinate space and 
the difference is between homologous prediction error 
components. 

Distl = >/( |E Rij -Min_errorR| 2 + | E Gij -Min_errorG | 2 + 
| EBij -Min^errorB | 2 ) 

Dist2 = V( lE Rij: -IntlR|. 2 + | E Gij - IntlG |. 2 + | E Bij - IntlB | 2 ) 
Dist3; = >/( | E Rij! -Int2R|; 2 + |E Gij - Int2G |; 2 + | E Bij .-Int2B \ 2 } 
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Dist4 = V(|E Ri j-Max_errorR| 2 * [ E Gij -Max^errorG | 2 + 
| E Bi j -Max_errorB | 2 ) 

xii) For each E ij= E Rij U E Gij U E Bi5 find the mini 
distance among Disti, Dist2, Dist3 and Dist4 . For 
example this may be Distl. 

xiii) Compose a bitstream as follows: 

a. P22 color = 16 bits 

b. P22 + Min_error = 16 bits ( = P22R+min_errorR 
U P22G+min_errorG U P22B+min_errorB) 

c. P22+Max_error- =16 bits (= P22R+max_errorR 
U P22G+max_errorG U P22B+max_errorB) 

d. For each P llt Pl2 , p 13 , p 21/ p 23# p 3i/ ^ 
a 2 bits code is associated following steps 11, 
12, 13. For example if Distl is the minimum 
distance for then the code associated and 
transmitted to it is 00. 

xiv) Each 3*3 block in encoded to 
16 + 16+16+ (8*2) =64 bits instead of 144 bits with a 
compression factor of 2.25 if the RGB source format is 
565. The value 3.375 if the RGB source format is 888. 

In the decoding process, the decoder will receive 
the incoming bitstream and proceed through the 
following steps: 

a. Get P22 

b- Get P22+Min_error (= P22R+min_errorR 
U P22G+min_errorG U P22B+min_errorB) 

c. Get P22+Max_error (= P22R+max_errorR 
U P22G+max_errorG U P22B+max_errorB) 

d. Then compute Min_error and Max_error 
inverting formula described in the above 
steps a,b for each color R,G,B as 
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i. Min_error = (P22+Min_error) -P22 

ii. Max_error = (P22+Max_error) -P22 

e. Next compute look-up prediction error 
palette as per step vii) c,d and viii) 

f . Use 2 bit code to address look-up 
table and adding the value (thus addressed) 
to P2 2 to recreate each P ±j . 

The arrangement disclosed iri the foregoing has 
been implemented for the following standard images and 
using two formats: RGB 565 and RGB 888, where 5, 6 or 8 
are the number of bits per color channel. 

1. 256x256 (horizontal x vertical size dimension) 

• Abstrwav 

• Bricks 

• Bricks2 

• Chapt 

• Forest 

• Image 0 

• Intel 

• Pixtest 

• Reference 

• Rov 

• Teleport 

• Topsmap 



2. 512x512 (horizontal x vertical size dimension) 

• Donut 

3. 640x480 (horizontal x vertical size dimension) 

• Balloon 

• DragonFly 

• Paper 

• Particles 
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• Sparkle 

These pictures are a representative set on which 
typically texture compression is applied. All pictures 
are in true-color format or 888, while the 565 are 
obtained from 888 truncating the 323 lowest bits of the 
888 pictures. Alternative truncating methods can be 
used to transform 888 pictures into 565 pictures such 
as "rounding to nearest integer'-, "Floyd-Steinberg 
dithering" etc. These alternatives do not entail, 
changes to the arrangement disclosed herein. 

To measure the performance of each algorithm, 
visual assessments and objective measures were 
performed, by taking two parameters as the reference 
15 measures, namely mean square error (MSE) and peak 
signal/noise ratio (PSNR) for each RGB channel. 

Figure 6 shows how measurements are carried out in 
the simulation environment. 

Input images IS in the 888 format (called 
Source888) are converted at 200 into the 565 format 
(called Source565), then compressed at 201 and further 
decompressed at 202 to the 565 format. These images are 
back converted at 2 03 into the 888 format to generate a 
first set of output images OS' (also called 
25 Decoded888) . 

The Source-565 images from block 200 are back' 
converted into the 888 format at 204 to generate a 
second set of output images OS' ' to be used as a 
reference (called Source565to888) . 

A first set of PSNR values (called PSNR 888) are 
computed between the Source 888 IS and the Decoded888 
OS' images. A second set of PSNR (called PSNR 565) 
values are computed between the Source565to888 OS" and 
the Decoded88 8 OS' images. 
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The 5 65 images are back reported- to the 888 format 
by simple zero bit stuffing of the 323 least important 
positions . 

How the Source888 IS images are converted to the 
565 foramt and back to the 888 format corresponds to 
conventional techniques that do not need to be 
described in detail herein. 

Mean squared (MSB)- and peak (PSNR) error are 
defined as follows: 

MSE = ( |Pij-Paij | 2 )/(w * h) where: 
Pij=source color 

Paij=processed color, after coding and 
decoding 

w, h= image width, height 

PSNR = 10 log 10 [ (2 bpp -l) 2 /MSE] where: 
bpp = bit per color 

Due to its predictive nature, the arrangement 
previously described is almost invariably able to 
achieve better performance, while yielding a lower 
compression ratio than S3TC. 

The proposed arrangement can be easily extended to 
Q=4xS=4 blocks by simply adding one more column at the 
right side and one more row at the bottom side of the 
Q=3xS=3 "chunk" . 

The main difference with respect to the embodiment 
described in the foregoing is related to the 
possibility of adopting a plurality of different 
patterns for extending the 3x3 block to a 4x4 block as 
best shown in figure 7 of the drawing. 

This extension will be described in the following. 
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i) Decompose the RG B image in non overlapped Qx& 
blocks of R g B colors 

ii) Consider the following Q=4xS=4 block composed 
of 16 pixels each one composed by R, G and ■ B 
components : 



10 



15 



Pij-Rij U Gi-j U B i;j (where P ±j is again the pixel at 

the ij position in the R G B image, and U is the union 
operator) 

(Rll Gil Bll) (R12 G12 B12) (R13 G13 B13) (R14 G14 B14) 

(R21 G21 B21) (R22 G22 B22) (R23 G23 B23) (R24 G24 B24) 

(R31 G31 B31) (R32 G32 B32) (R33 G33 B33) (R34 G34 B34) 

(R41 G41 B41) (R42 G42 B42) (R43 G43 B43) (R44 G44 B44) 



iii) Decompose the above block in three sub-blocks 
called sub-block R, sub-block G and sub-block B 
20 respectively, as shown below, wherein each block 
includes only a color component 

Rll R12 R13 R14 sub-block R 
R21 R22 R23 R24 
25 R31 R32 R33 R34 
R41 R42 R43 R44 
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Gil G12 G13 G14 sub-block G 
G21 G22 G23 G24 
G31 G32 G33 G34 
G41 G42 G43 G44 
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Bll B12 B13 B14 sub-block B 
B21 B22 B23 B24 
B31 B32 B33 B34 
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B41 B4 2 B4 3 B44 

iv) Define a 1 st predictor for each sub-block 

5 g. R22 as prediction for 3x3 colors 

surrounding R22 (i.e. Rll, R12, R13, R21, ,R23, 
R31, R32, R33) ' 

h. G22 as prediction for 3x3 colors 
surrounding G22 (i.e. Gil, G12, G13, G21, G23, 

10 G31, G32, G33) 

i. B22 as prediction for 3x3 colors 
surrounding B22 (i.e. Bll, B12, B13, B21, B23, 
B31, B32, B33) 

15 See / in that respect, figure 7a, where this 

prediction pattern is represented geometrically. 

v) Define 

2 nd set of predictors (see figure 7b) 

i. R23 as prediction for R14 R24 R34 

ii. R32 as prediction for R41 R42 R43 

iii. R33 as prediction for R44 

iv. G23 as prediction for G14 G24 G34 

v. G32 as prediction for G41 G42 G43 

vi. G33 as prediction for G44 

vii. B23 as prediction for B14 B24 B34 

viii. B32 as prediction for B41 B42 B43 

ix. B33 as prediction for B44 



20 j 
where : 
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k. or a 3 rd set of predictors (see again the 
pattern shown in figure 7a) with 

i. R13 as prediction for R14 

ii. R23 as prediction for R24 

iii. R33 as prediction for R34 R44 R43 1 
- iv. R31 as prediction for R4i 

v. R32 as prediction for R42 

vi. G13 as prediction for G 14 

vii. G23 as prediction for G24 

viii. -G33 as prediction for G34 G44 G43 

ix. G31 as prediction for G41 

x. G32 as prediction for G42 

xi. B13 as prediction for B14 

xii. B23 as prediction for B24 

xiii. B33 as prediction for B34 B44 B43 

xiv. B31 as prediction for B41 

xv. B32 as prediction for B42 

It will be appreciated that . other prediction 
patterns are feasible, as shown in figures 7c to 7h. 

vi) Compute for each sub-block the following 
prediction differences: 



1 . Sub-block R 

i. (R22-R11), (R22-R12), (R22-R13), (R22- 
R21), (R22-R23), (R22-R31) , (R22-R32), (R22- 
R33) 

ii. and the differences: between 
predictors as defined in step v.j and 
v.k and related homologous colors 

m. Sub-block G 

i. (G22-G11) , (G22-G12) , (G22-G13) , (G22- 
G21) # (G22-G23), (G22-G31), (G22-G32) , (G22-G33) 
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ii. and. the differences between 
predictors as defined in step v.j) and v.k) 
and related homologous colors 
n. Sub-block B 

i. (B22-B11) , (B22-B12) , (B22-B13) , (B22- 
B21) , (B22-B23) , (B22-B31) , (B22-B32) , (B22-B33) 

ii. and the differences between 
predictors as defined in step v.j) and v.k) 
and related homologous colors 

o. From this point onwards, up to 8 full 
encodings of the block will run in parallel 
depending on the set of predictors used (since up 
to 8 prediction configurations are possible) . At 
the end of the 6 encodings the arrangment 
15 disclosed herein will compute the MSE between 

block before and after each encoding (out of 8 
possible) . The one with the minimum MSE will be 
selected to generate the bitstream that will be 
sent to the decoder. 

20 

vii) Sort in ascending order the prediction 
differences for each sub-block as shown in figure 8. 
Each number is the position that addresses each 
prediction differences i n ascending order. 

25 Specifically, figure 8 shows R or G or B sub-block 
prediction differences sorted from left to right in 
ascending order 



viii) Two groups are defined by the sorted 
30 prediction differences. The first is composed by the 

three lowest elements and the second by the three 
highest as shown in figure 8. 

ix) Set a look-up prediction differences palette 
35 composed as follows: 

t 
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e. 1 st value is the median of the 1st group 
as defined in step 8 for sub-block R prediction 
differences. The same applies for sub-block G and 
B ' thus yielding min_median_errorR, 

min_median_errorG / min_median_errorB . 

f- 2 nd value is the median of the 2 nd group as 
defined in step 8 for sub-block R prediction 
differences. The same applies for sub-block G and 
B ' thus yielding max_median_err P rR, 

max_median_errorG, max_median_errorB . 



3 rd is Intl composed by 
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i . IntlR= (2*min_median_errorR + max_median_error) /3 , 
IntlG= (2*min_median_errorG+max_median_errorG) /3, 
IntlB= (2*min_median_errorB+max_median_errorB) /3 ' 

h. 4 th is Int2 composed by 

i . Int2R= (min_median_errorR+2*max_median_errorR) /3 , 
Int2G= (min_median_errorG+2*max_median_errorG) /3 
Int2B= (min_median_errorB+2*max_median_errorB) /3 ' 

In figure 9 the groups and the two representative 
colors for each R, G, B sub-block are shown. 

(In fact the relationships reported in the 
foregoing correspond to the presently preferred choice 
within the general relationships: 

Intl (R, G, B)= 

(a*min_median_errorR+b*max_median_errorR) / ( a+ b) , 
(c*min_median_errorG+d*max_median_errorG) / ( c+ d) ', 
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(e*min_median_errorB+f *max_median_errorB) / (e+f ) , 
Int2 (R, G, B) = 

(g*min_median_errorR+h*max_median_errorR) / (g+h) , 

(i*min_median_errorG+l*max_median_errorG) / (i+1) , 

(m*min_median_errorB+n*max_median_errorB) / (m+n) 

where a, b, c, d, e, f, g, h, i, 1, m, 
and n are weighing factors) . 

x) Define the look-up prediction error palette as 
Look-up table = 

[Min_median_errorR, IntlR, Int2R , Max_median_errorR] 
[Min_median_errorG, IntlG, Int2G, Max_median_errorG] 
[Min_median_errorB, IntlB, Int2B, Max_median_errorB] 

xi) Associate the following 2 bits code with each 
column of the above palette 

Look-up table = 

[Min_median_errorR, IntlR, Int2R, Max_median_errorR] 
[Min_median_errorG, IntlG, Int2G, Max_median_errorG] 
[Min_median_errorB, IntlB, Int2B, Max_median_errorB] 

2 BITS CODE = 00 01 10 11 

xii) For each Pij = R ±j u G i6 U B ±i (where i ranges 
from 1 to Q=4 and j ranges from l to S=4) compute the 
prediction error using, predictors as defined in steps v 
and vi . 
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p. Define the prediction error E H = E Rij U E Gij . u 
E Bij = (PredictorR kl - Rij ) u (PredictorG kl -G i;j ) u 
( Predi ct orB k i -Bi j ) 

xiii) For each compute the Euclidean distance 

between it and each look-up color as defined above in 
step ix. This is again the Euclidean distance between 
two points in a three-dimensional coordinate space and 
the difference is between homologous prediction error 
components. 

Distl=V( | E Ri j-Min_median_errorR | 2 + | E Gi:j - 
Min_median_errorG | 2 + | EBj -Min_median_errorB | 2 ) 

Dist2=V ( | E Rij - Int 1R | 2 + | E Gij - Int 1G | 2 + | E Bij - int IB | 2 ) 
Dist3=V( | E Rij - Int 2R | 2 + | E Gij - Int 2G | 2 + | E Bij - Int 2B | 2 ) 
Dist4=V ( | E Rij -Max_median_errorR | 2 + | E Gij - 
Max_median_errorG | 2 + | E Bij -Max_median_errorB | 2 ) 

xiv) For each Eij = E Rij U E Gij U E Bij find the 
minimum distance among Distl, Dist2, Dist3 and Dist4 . 
For example, this may be Distl, and the two-bit code 
associated thereto is 00. 

xv) Each Q*S block is fully coded in 8 different 
sessions, where in each session uses one of the 8 
configurations for the predictions shown in figures 7a 



to 7h: 



a. decode as per steps from xvi) below onward 
each of these 8 coded blocks 

b. for each decoded block and for each color 
component R, G or B compute the sum of squared 
differences between decoded colors and source ones 
(the one before their encoding) 

c. add the 3 numbers computed during step 
xv. b and find the minimum between the 8 options 



25 



xvi) Compose a bitstream as follows:. 

q. P22 color = 16 bits 

r. P22+Min_median_error = 16 bits 

(= P22R+Min_median_error u 

P2 2G+Min_median_errorG U P22B+Min__median_errorB) 

s. P22+Max_median_error = 16 bits ( = 
P22R+Max_median_error U P22G+ Max_median_errorG U 
P2 2B+ Max_median_errorB) 

t. For each P llf P 12 , p 13/ p 14 , p 21/ p 23/ p 24/ 
P31, P32/ P33, P34/ P41/ P 4 2/ P43/ P44 a 2 bits code is 
associated following steps iv) , v.j) or v.k), vi) , 
xii) , xiii) , xiv) . 

u. One of the 8 options (encoded with 3 bits) 
as per step xv.c will be coded in this way 

i. 2 more bits are added to the 
bitstream 

ii. 1 virtual bit is coded putting 
P22+Minjnedian_error before or after 
P22+Max__median_error inside the bitstream 

xvii) For each block send the bitstream as defined 
in step xvi) to a decoder process. 

xviii) Each QxS=4*4 block in encoded to 
16+16+16+ (15*2) +2=80 bits = 16*5 = 10 bytes instead of 
256 bits allows a compression factor of 3.2 if the RGB 
source format is 565. It is 4.8 if the RGB source 
format is 88 8. 

In the decoding process, the decoder receives the 
incoming bitstream and performs the following steps: 
v. getP22 

w - 9 et P22+Min_mediah_error after 

P22+Max__median_error or P22+Min median error 
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before P22 + Max_median_error : in this way the 
virtual bits as per step xvi.u.ii) are retrieved) 

x. get 2 more bits that with the virtual bits 
will build the 3 bits as per step 16. u to select 
5 how to make the prediction by resorting to one of 

the patterns adrressed by these three bits as 
shown in figure 7a to 7h 

y. Then compute Min_median_error (step xix.w- 
P22) and Max_median_error (step xix.w-P22) 

10 Z - Next ^Pute look-up prediction error 

palette as per step 9 

aa. Use 2 bit code to address look-up table 
and adding the value stored at this address to P22 
as defined in step 4 to recreate each 

15 bb - Use colo ^ s decoded at step xix.aa as 

predictors (like defined in step v) 

cc. Use 2 bit code to address the look-up 
table and adding the value stored at this address 
to predictors defined in xix.bb) to recreate each 
remaining color 

The arrangement just described has been 
implemented the same set of pictures defined 
previously. 

The results show that the instant predictive 
25 arrangement is able tc achieve at least the same 
performance levels of S3TC and yields a compression 
factor slightly lower than S3TC on 565 sequences. 

The proposed arrangement however achieves 
unquestionably better quality in the both the 3x3 and 
30 4x4 versions, in spite of a lower compression ratio 
d.e. ln 4x4 reaches 80% of performance of S3TC) . Even 
when worse quality has been measured, visual 
assessments showed imperceptible artifacts. 

Of course, without prejudice to the underlying 
principle of the invention, the details and embodiments 
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may vary, also significantly, with respect to what has 
been described and shown by way of example only, 
without departing from the scope of the invention as 
defined by the annexed claims. 
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EPO- Munich 
51 

ORFBb. 2003 

CLAIMS 

1 . A method for texture compressing images having, 
a plurality of color components (R, G, B) , the method 
including the step of decomposing the images in sub- 
blocks each including only one said color component (R, 
G, B) , characterized in that it includes the steps of: 

- defining at least one first predictor (R22, G22, 
B22) for each said sub-block, 

- computing for each said sub-block a respective 
set of prediction differences between at least some of 
the pixels of the sub-block and said predictor (R22, 
G22, B22) , 

- sorting the prediction differences for each sub 
block, 

- generating a look-up prediction differences 
palette and defining therefrom a look-up prediction 
error palette, and 

- associating a code with each column of said 
error palette. 

2. The method of claim 1, characterized in that 
said code associated with each column of said error 
palette is a two-bit code (00, 01, 10, 11) . 

3. The method of either of claims 1 or 2, 
characterized in that it includes the steps of: 

- computing for each pixel (Pij) in said images a 
respective prediction error (Ei j ) using as a predictor 
a given pixel (P22) of said images, said given pixel 
(P22) being the union of the first predictors for said 
sub-blocks (R, G, B) , 

- for each said prediction error (Ei j ) , computing 
the Euclidean distance (Distj ) between said prediction 
error and each each look-up color in said look-up 
prediction palette, the difference being between 
homologous prediction error components, 
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- for each respective prediction error (Ei j ) find 
the minimum of said distance, and 

- composing a bitstream as follows: 

a. P22 color = 16 bits 

b. P22+Min_error = 16 bits 

c. P22+Max_error =16 bits 

where P22 is said given pixel used as a predictor 
and Min_error and Max_error are the minimum and maximum 
prediction errors per each R,G,B component in the block 
under coding. 

4. The method of claim 1, characterized in that it 
includes the step of defining a said first predictor 
(R22, G22, B22) for each said sub-block' (R, G, B) as 

prediction for the respective sub-block excluding the 
predictor (R22, G22, B22) itself. 

5. The method of either of claim 1 or claim 4, 
characterized in that it includes the step of computing 
for each said sub-block a respective set of prediction 
differences comprised of the differences of said 
predictor to all the other pixels in the respective 
sub-block (R, G, B) . 

6. The method of any of claims 1, 4, or 5, 
characterized in that it includes the step of sorting 
said prediction differences in ascending order in each 
said sub-block (R, G, B) . 

7. The method of claim l, characterized in that it 
includes the step of generating a said look-up 
prediction differences palette wherein: 

- a first value is the minimum of the 
prediction differences of each said sub-block 
(R, G, B) , notated min_errorR, min_errorG, 
and min_errorB, respectively 

- a second value is the maximum of the 
prediction differences of each said sub-block 
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(R, G, B) , notated max^errorR, max^errorG, 
and max_errorB, respectively 

- a third value, notated Intl, is composed by 

(a*min__errorR+b*max_errorR) / (a+b) , 
(c*min_errorG+d*max_errorG) / (c+d) , 
(e*min_errorB+f *max_errorB) / (e+f ) / 



- a 
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fourth value, notated Int2, is composed 

(g*min_errorR+h*max__errorR) / (g+h) , 
(i*min_errorG+l*max_errorG) / (i+1) , 
(m*min_errorB+n*max_errorB) / (m+n) 

where a, b, c, d, e, f, g, h, i, 1, m , 
and n are weighing factors. 

8. The method of claim 7, characterized in that it 
includes the step of generating said look-up prediction 
error palette as 

[Min_errorR, IntlR, Int2R, Max^errorR] 
[Min_errorG, IntlG, Int2G, Max^errorG] 
[Min__errorB f IntlB, Int2B, Max_errorB] 

9, The method of claim 3 and claim 8, 
characterized in that it includes the step of 
associating the following two-bit codes with each 
column of said look-up prediction error palette: 

[Min_errorR / IntlR, Int2R, Max_errorR] 

[Min_errorG, IntlG, Int2G, Max_errorG] 

[Min^errorB, IntlB , Int2B, Max_errorB] 

2 BIT CODE = 00 01 10 11 
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10. The method of any of claims 7 to 9, 
characterized in that it includes the step of computing 
said Euclidean distance as: 

Disti = V(|E Rij -Min_errorR| 2 + | E Gij -Min_errorG| 2 + 
| EBij -Min_errorB | 2 ) 

Dist2 = V(|E Rij -IntlR|: 2 + |E Gij -lntlG| 2 + | E Bij -IntlB | ; 2 ) 
Dist3 = V(| E Rij -Int2R| 2 + |E Gij -Int2G|; 2 + | E Bij - Int2B | 2 ) 
Dist4 = V(|E Rij -Max_errorRl 2 + I E Gij -Max_errorG | 2 + 
| E Bi j -Max_errorB | 2 ) 

11- The method of claim 1, characterized in that 
it includes the step of defining said first predictor 
(R22, G22, B22) for each sub-block as a prediction for 
a set of colors surrounding said predictor (R22, G22 
B22) . 

12. The method of claim 11, characterized in that 
it includes the steps of : 

- defining two groups of said sorted prediction 
differences, said groups being composed of the lowest 
elements and the highest elements in the sorting, 

- generating a said look-up prediction differences 
palette wherein: 

- a first value is the median of said first group 
of prediction differences for each said sub-block, 
notated min_median_errorR, min_median_errorG, and 
min_median_errorB, respectively, 

- a second value is the median of said second 
group of prediction differences for each sub-block, 
notated max_median_errorR, max_median_errorG,' 
max_median_errorB, respectively, 

- a third value, notated Intl, is composed by 
(a*min_median_errorR+b*max_median_errorR) / (a+b) , 
(c*min_tnedian__errorG+d*max_median_errorG) / (c+d) , 

(e*min_median_errorB+f *max_median_errorB) / (e+f ) , 

- a fourth value, notated Int2, is composed by 
(g*min_median_errorR+h*max_median_errorR) / (g+h) , 
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(i*min_median_errorG+l*max_median_errorG) / (i+1) , 
(m*min - median - errorB+n*max_median_errorB) / (m+n) 

where a, b, c, d, e, f, g, h, i, 1, m, and n are 
weighing factors. 

13. The method of claim 12, characterized in that 
it includes the step of generating said look-up 
prediction error palette as 

[Min_median_errorR, Int lR/Int2R, Max_median_errorR] 
[Min_median_errorG, IntlG, Int2G, Max_median_errorG] 
[Min_median_errorB, IntlB, Int2B, Max_median_errorB] 

14. The method of claim 13, characterized in that 
it includes the step of associating with each column of 
said error palette the following bit codes: 

[Min_median_errorR, IntlR, Int2R / Max_median_errorR] 
[Min_median_errorG, IntlG, Int2G, Max_median_errorG] 
[Min_median_errorB, IntlB, Int2B, Max_median_errorB] 

2 BIT CODE = 00 01 10 11 

15. The method of claim 1, characterized in that 
it includes the steps of: 

- defining a second set of predictors (R23, R22, 
R32, R33; G22 , G23, G32, G33; B22, B23, B32 , B33) and a 
plurality of respective scanning patterns in each sub- 
block (R, G, B) to generate prediction error among said 
predictors and the pixel of the block, 

computing said respective prediction error 
(Eij), thus generating a plurality of sets of 
prediction differences for said sub-blocks, whereby a 
corresponding plurality of coding options are available 
corresponding to said sets, said plurality being 
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determined by said sets and the number of said sub- 
blocks , 

- coding said image by means of said plurality of 
coding opt ions , 

- computing, for each image block and each color 
component (R, G> B) , a difference value with respect to 
the source colors for all colors inside the block 
before encoding, and 

find the minimum for said value over said 
plurality of coding options. 

16. The method of claim 15, characterized in that 
said difference value is computed as a sum of squared 
differences . 

17. The method of either of claims 15 or 16, 
characterized in that it includes the steps. of: 

- composing a bitstream as follows: 

q. P22 color = 16 bits 
r. P22+Min_median_error = 16 bits 
s. P22+Max_median_error = 16 bits 
where P22 is said given pixel used as a predictor 
and Min_median_error and Max_median_error are the 
minimum and maximum prediction errors per each R,G,B 
component inside the block under coding, 

- associating said code to each pixel (P U/ p 12 , 
Pl3, Pl4, P 2 i, P 23 , P 24 , P 3 i, P 32 , P 33 , P34, P41, P42, P43, 
P44) in said image other than said given pixel (P22) , 
whereby one of said plurality of options is coded, 

- adding a group of additional bits to the 
bitstream, 

coding one virtual bit by putting 
P22+Min_median_error before or after 

P22+Max_median__error inside the bitstream, 

- sending said bitstream to a decoder process to 
generate decoded colors, and 
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- computing; said difference value before encoding 
for each image and for each color component (R, G, B) . 

18. The method of any of the previous claims, 
characterized in that said color images are RGB color 
images and said color components are the R, G, and B 
components of said RGB images. 

19. A method for decoding a bitstream encoded with 
the process of claim 3, characterized in that it 
includes the steps of : 

- deriving P22 , P22+Min_error , and P22+Max_error 
from said bitstream, and obtain therefor Min_error and 

Max error, 

— — \f 

- computing said look-up prediction error palette 
using said bit code to address said look-up table, and 

adding the value thus retrieved to P22 to 
recreate each pixel in said images (Pij) . 

20. A method for decoding a bitstream encoded 
with the process of claim 17, characterized in that it 
includes the steps of: 

deriving P22, P22+Min_median_error , and 
P22+Max_median_error from said bitstream, and obtain 
therefrom Min_median_error and Max_median_error , 

- computing said look-up prediction error palette 

by : 

- using said code to address said look-up table 
and adding the value stored at this address 
to P22 to recreate each pixel (Pij) , 

using the colors thus decoded as predictors, 

- using said code to address said look-up table 
and adding the value stored at this address 
to said predictors to recreate each remaining 
color. 

21. A processor configured for carrying out the 
method of any of claims 1 to 2 0 in the form of a. 
dedicated processor. 
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22. A processor configured for carrying out the 
method of any of claims 1 to 2 0 in the form of a 
suitably programmed general -purpose processor. 

23. A computer program product directly loadable 
into the memory of a digital computer and including 
software code portions performing the method of any of 
claims 1 to 2 0 when the product is run on a computer. 
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A method for texture compressing images having a 
plurality of color components (R, G, B) , includes the 
5 step of decomposing the images in sub-blocks each 
including only one color component. At least one first 
predictor is defined for each said sub-block and a 
respective set of prediction differences is computed 
for each sub-block. Then the prediction differences for 
10 each sub block are sorted, and a look-up prediction 
differences palette is set up by defining therefrom a 
look-up prediction error palette. A code is associated 
with each column of the error palette. 
(Figure 5) 
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